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(54) Title: PERSONAL SERVER TECHNOLOGY 

ON (57) Abstract: The present invention is a connectivity solution that integrates the electric and electronic-based objects in a home, 
00 ofGce or other space into an integrated control, and monitoring, and computing network. The present invention comprises a server- 
like apparatus that mediates the control, monitoring, and computational functions. A user enters commands and receives information 
^2 fr 0 " 1 a remote device that communicates with the server-like apparatus. The remote device functions both within the networked space 

(e.g., in and around the home or office), and from outside of it (via modem connection, the Internet, or some other type of external 

access). VCRs, TVs, home entertainment systems, kitchen appliances, light fixtures, pools, alarms systems, environmental controls, 
cameras, microphones, computers and weather stations are just some of the objects that can be controlled and monitored by the user 
from a Remote Device. The remote device presents the user with a powerful, easy-to-use interface environment that intuitively maps 
to the objects on the network. The present invention thus brings the user remote connectivity to things that are most important to the 
user and implements an automated, intelligent, seamlessly connected "home or office of the future". 
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PERSONAL SERVER TECHNOLOGY 


by Inventors ! j 

ALAN DAVID FINKE 
5 . ? ' JOHN ERIC BUCHBINDER 

Background of the Invention 

10 

1. Field of the Invention ^ 

The present invention is a connectivity solution for use in the home, office and other 
locations. It comprises a server- like apparatus that integrates home appliances, 1 

L5 entertainment systems, computing devices, and other objects into a coordinated wifeless 
control and monitoring network. A remote "device is used to control arid monitor these 
objects via the functioning of the server-like apparatus. The server-like apparatus is also 
connected to other networks, such as the Internet. The remote device presents the user 
with a powerful, easy-to-use interface environment that intuitively maps to the objects on 

20 the network and the actions and activities being performed. The present invention thus 
implements an automated, intelligent, seamlessly connected "home or office of the 
future/' ' " ; _ ' ' " 

2. Description of Related Art 

25 ' 1 

The prior art includes numerous systems that monitor and control electronic appliances 
and other objects in the home and office. Such systems are limited almost exclusively to 
"remote control" - the use of a hand-held device to send instructions directly to and 
receive information directly from one, of at most a few, objects. One example of such a 

30 remote control device is the standard VCR remote^ which operates on infrared light 1 
wavelengths ("tR"). A VCR remote is typically used to program recording parameters 
into a VCR and to operate the VCR in real-time. Similar 5 remotes exist for TVs, CD 
players and other appliances. tights and other household fixtures can also be controlled 
by remote, usually by installation of a component that allows for simple, commands such 

35 as on/off and dimming in response tp hardwired timers, audible input, or other control 
means. ' ' ! * ' : '" '"'^ " ; v ; ; 1 - ' *' 1 . 

However, the state of remote coritrol m the cxirreht aft is nascent. Some objects such as 
VCRs and CD players usually have remote control devices, but many do not. Even r ' 

40 among the objects that do have remote control,' such objects are hot controlled through' 
integrated networks. In fact, the notion 6f a connectivity system or solution hardly 
applies to the state of the current art. Of the! festively few objects in a present-day home 
or office that can be controlled by remote, each one generally requires a separate remote 
control device. Sometimes, a handful of objects can be controlled with a single remote 

45 (e.g., CD player, amplifier and tuner all from a single manufacturer that are standardized 
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to a single remote, or the "universal" remote mat can control a large number of TVs and 
VCRs). , : : . •. < • . . - 

The current art does include home control systems that allow a user to control lights, 
5 sound systems, and other fixtures throughout the household. s While appearing to be more 
of a true "control network," these systems still exhibit only rudimentary control over and 
feedback from objects that are connected to the network. In addition, these systems axe 
difficult to implement, and do not offer the power and flexibility of a programmable, 
software-based network. They also cannot be controlled and monitored from outside the 
10 home via network and Internet connections. 

The true networks that do exist in the current art are essentially limited to information 
exchange. For instance, U.S. Patent 5,809,415, issued to Rossmann, whibh is herein 1 
incorporated by reference in its entirety, describes a two-way, portable data- 
15 communication- device that allows a user access to a wide-area network such as the 

Internet. Such inventions are limited in the opposite way that home-control and remote- 
control systems^ are limited. The former cannot' manipulate aridmonitor the physical 
world, at least not to any appreciable degree, while the latter lack the information, control 
and integration aspects of a true network. . . ? 

20 . . ( . . ■ ' . .' 

For these reasons, among others, there is a need in the art for a true network that can bring 
a large number of objects under the control of a- single, integrated connectivity solution. 
This solution would ideally be flexible enough to be programmed for different network 
configurations and settings with ease, and be powerful enough to allow the user to have 
25 precise control and perception of the objects in the network through the metaphor of an 
intuitive user interface. 

Summary of the Invention 

30 The present invention offers an integrated connectivity solution for remote control of . 
various network integrated household and office .obj ects ("Controlled Devices"), It 
comprises a software-based network that can.perfopn information-heavy tasks and tl^at 
incorporates sophisticated object monitoring and control,, as. well as computational t 
activities, into thq network. The present invention consists of a server-like apparatus ' 

35 ("Personal Server") that controls a rietwork, and performs computational tasks, in the 
home, office, or other location. The Personal Serye^ is accessed through a Remote 
Device, generally a hand-held, personal digital assistant ("PDA"), a data-enabled 
telephone or cellular phone ("SmartPhone"), or some form of internet access device. 
PALM O/S™ devices such as the PALM PILOT™, PALM m™ and PALM IV™, and 

40 WINDOWS CE™ devices such as the. PHILIPS : NiNp TM , CASIO CASSIOPEIA™ and 
HP JORDANA™ : are common PDAs that are readily adaptable for use with the present 
invention. The QuallCpm PdQ phone, a cellular phone with digital computing and 
display capabilities, is an.example of a SmartPhone that, will work well with the present 
invention. k ' . , . 


The present invention allows users to contrqfand monitor various Controlled Devices. 
These functions can be accomplished, from within the location where the Personal Servier 
is located, or from the outside world thorough a dial-up connection, networic, or the 
Internet, or other : means. Remote information tasks, such as file exchange, computational 
activity and financial transactions can also be carried out by the Personal Server, using a 
Remote Client operating on a Remote Device as the interface. Third parties, such as 
alarm companies, and police departments, can be given fixll or partial access to the 
monitoring and control functions of the Personal Server. , , ' / 

Brief Description of the Drawings 

The purpose and advantages of the present invention will be apparent to those skilled in 
the art from the following detailed, description in conjunction with the appended 
drawings, which show typical embodiments of the invention. 

FIGURE 1 illustrates a preferred embodiment of the Personal S erver, including Action 
Modules 1, S cheduler/Router ! and Input/Output Modules 3. Examples of Input/Output 
Modules, including typical connection objects/protocols, are included. 

FIGURE 2 illustrates some examples of the physical connection and data transfer 
protocols that can be used between the Remote Device and the Personal Server. 

FIGURE 3 shows a control panel that is used to configure the network of objects on the 
Personal Server, in this case, those objects that are on an ACTIVEHOME™ XI 0 system. 

FIGURE 4 shows an example of a screen on the gemote Client interface running on the 
Remote Device used with the present invention, in this case, Home Pad. Home Pad is 
used to control Controlled Devices such as home appliances and fixtures. 

FIGURE 5 shows an embodiment of Home P ( ad on a more graphically limited Remote 
Device, namely, a cell phone. 

FIGURE 6 shows a second example. of a screen on the Remote Client interface running 
on the Remote Device used with the present invention, in this case, Credit Pad. Credit . '. . 
Pad is used to verify and charge credit card numbers. . , , f : 

FIGURE 7 shows a third example of a screen on the Remote Client interface running on 
the Remote Device used with the present invention, in this case, File Retriever. File 
Retriever is used to retrieve files from the Personal Server. 


Detailed Description of the Preferred Embodiments , 

Reference will now be made in detail to preferred embodiments of the invention; so as to 
enable a person skilled in the art to make and use the invention in the context of a 
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particular application- It is understood that such embodiments are not intended to limit 
the invention to one preferred embodiment or application.-' 'On the contrary, the invention 
is intended to'cbviei; alternatives, modifications, arid equivalents. Various modifications 
to the present invention will be readily apparent to one of ordinary skill in the art, and can 
5 be made to the described embodiment within the spirit and scope of the invention as 
defined by the appended claims. ' 

In a preferred embodiment, the core of the present invention is a server- like apparatus 
("Personal. Server"). The Personal Server, in a preferred embodiment, comprises 

10 software run on a general-purpose computer. The computer can be a server, workstation, 
dedicated hardware device, or any other type of computer,.but in this described 
embodiment, the computer is a desktop PC. In other embodiments, the Personal Server 
comprises hardware specifically designed for the invention, or a combination of hardware 
and computer software. 1 The software can be ^ component- bought off the shelf, a ' • ■ • 

1 5 component specially designed for a particular home or office*' a pltig-in to a software 
developer's kit, or part of a larger proprietary system, among other embodiments. The 
software of the Personal Server is typically written in C, C-t-+ or Java. The Personal 
Server is designed to have a robust and flexible interface that makes it easy for developers 
to develop Input/Output and Action Modules that operate with the present invention. 

20 

1. Software Architecture J : t 

a. Personal Server 

The following is a preferred embodiment of the" software architecture of the present 
25 invention. FIGURE 1 illustrates a further preferred embodiment,' in detail: ; 

The Personal Server has a software architecture that consists of the following 
components: (1) Input/Output Modules, (2) a core Scheduler/Router with data logging 
capabilities and (3) Action Modules. The Input/Output Modules and Action Modules are 

30 self-contained code libraries designed to be detected by the Scheduler/Router and 

connected at run-time. This architecture allows deVelopers and consultants to develop 
additional modules, either for a class of users or Controlled Devices or on a case-by-case 
basis for specific individual users, to fit those users needs. In particular, as new forms 
communication, types of Controlled Devices, and' activity 11 are developed through 

35 technological development and commercial innovation, new type of modules will be "' ; ■ 
developed. Such modules can be added to the Personal Server by direct installation or by 
downloading on an ad-hoc basis from remote sources. They can also be dynamically 
added to individual installations of the Persbrial Server, with or without user intervention, 
to minimize service interruption. ; ■ < ! :> ■ i? * : ; 1 

40 ~" 'Ki.; ' ' ' 

Input/Output Modules serve to connect a user's Remote Device to the Personal Server, 
. but they can be designed for other modes of communication as well. Various types of 
physical connections and data-transfer protocols can be used, as' illustrated in FIGURE 2. 
At synchronization, the Remote Device sends the information entered by the user to an 

45 Input/Output Module or Input/Output Modules. This information is translated into a 
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"Message" by the Input/Output Module, Messages generally contain information on the 
user, the Remote Device, the target Action Module and data specifics. TheJ/tes^age may 
be encoded or encrypted for the purpose of data security. In one; encryption-scheme, 
Messages are encrypted by the Remote Device prior to transmission, and then decoded 
5 by the Input/Output Module. The Input/Output Module then passes the Message to the 
Scheduler/Router, which logs it into a database^ processes it as necessary, and passes the 
Message again to the appropriate Action Module. The Action Module then performs the 
requested actions. After the action has been.coimpleted, the Action Module creates a 
second Message containing user-requested inforpiation, results of calculations or ; 

10 computations, information on whether the action has been successfully completed, date 
and time stamps, and whether additional instructions are needed.; The Action Module 
posses the Message to the Scheduler/Router, which logs it, processes it as necessary, and 
passes it, if necessary, to the Input/Output Module that communicates its contents, 
possibly in encrypted format, to the Remote. Device. Additional messages not specifically . , 

15 mentioned may be created and sent as particularly in other embodiments. Alternate 

embodiments employ separate Input Modules and Output Modules rather than conibined 
Input/Output Modules. In such alternate embodiments, Input Modules are responsible for e , 
receiving Messages from the Remote Device, whereas Output Modules are responsible 
for sending Messages to the Remote Device. 

20 

At start-up, the Scheduler/Router loads the existing Input/Output Modules and, Action , 
Modules and monitors them for activity. As noted, the Scheduler/Router processes and 
relays Messages between the Input/Output and Action Modules. It maintains information 
on user identification, user password and security information, as well as logs of the , 
25 Messages. In a preferred embodiment, a Utility Module is written as an adjunct to the 
Scheduler/Router, which allows the user to enter settings. The Utility Module will 
generally have a control-panel type interface to aid in configuring new user preferences 
and new modules. , 7 

30 The Action Modules or the Scheduler/Router may initiate messages to the user. If the \ 
user has requested an action to be performed that may take a long time^ the user may 
disconnect and request that the results be sent back at a later time. Alternately, a . t \, 
Controlled Device may initiate a communication, triggering an Action Module to send a 
Message to the Scheduler/Router. In this way, the user may configure the system so that 

35 the Personal Servicer initiates communication when triggered by an event such as a home , 
alarm being set off Results may be sent back when the user connects again, by a 
connection established by the Personal Server* or by another communication means such 
as pager, telephone, fax* or e-mail. ; .-. . . 

40 b. Input/Output Modules 

As described in the section above, Input/Output Modules serve as connection points , 
. between the Personal Server and the' Remote Device. The various Input/Output Modules 
in place with a particular embodiment of the Personal Server are designed to handle 
various connectivity and data-transfer protocols (some examples of which are listed in 
45 FIGURE 2). In a preferred embodiment, proprietary PDAs protocols such as 
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HOTSYNC™ (for PALM OS™ devices) and y\GTIVESYNC™ (for WINDOWS CE™ 
devices) are among^these protocols. In the case of incoming Messages an Input/Output 
Module comitfunieates with a Remote'Device by synchronizing with the Remote Device, 
receiving and interpreting a Message from the Remote Device, optionally-decrypting the 
5 Message if it is in encrypted form, and then passing the Messages on to the 

Scheduler/Router which in turn optionally passes that Message in original or modified 
form on to an Action Module and possibly a Controlled Device. In the case of outgoing > ■ 
Messages an Input/Output Module communicates with' a Remote Device by 
synchronizing with the Remote Device, receiving and interpreting a Message from the 
10 Scheduler/Router (which Message may have originated from a Controlled Device or . ' - - 
Action Module); optionally encrypting the Message, and then passing the Messages on to 
the Remote Device, which in turn decrypts' the Message f as necessary. . , . f . - 

1 5 In alternate embodiments connection to the Input/Output Modules may be mediated by an 
Internet scrvicie designed specifically to communicate with the Personal Server, or else to 
a general-purpose Internet service (the "Service'-'). The user operating the Remote Device 
may log in or otherwise connect to the Service. In either 'event, the user accesses a 
network server (the "Internet Server") which runs the Service via a webiste or other user , 

20 interface. Once the user has logged in using a Remote Device, the Service will then 

complete the final link to the Personal Server. The Service may dial-in, or use any of the 
means of connectivity supported by the Input/Output Modules, and then communicate 
with the Personal Server using standard protocols. The Messages from the Personal 
Server are then communicated back to the user. Thus a user can use a Remote Device 

25 such as a Web-enabled cellular phone to connect to a Personal Server at home or at the 
workplace.* . — 

In alternate embodiments there may be no encryption provided, or the 
encryption/decryption function may occur at different locations on the system such as at , 
30 the Scheduler/Router, Action Module, or Controlled Device rather than or in addition to 
the encryption provided by the Input/Output Module; * brother alternate embodiments 
encryption/decryption functions may occur at the level of the Remote Client or the 
Service rather than or in addition to the encryption provided by the Remote Device. 

35 c. Action Modules 3 : ( 

The Action Modules are the software -objects that actually carry out instructions specified . 

by the user, and that obtain status and other information from and send instructions to the 

Controlled Devices. Because of the wide variety of specific actions they carry out, Action. 

Modules will often include their own databases to assist in their functions. Some Action 
40 Modules will have their own connectivity to the Web and to other communication lines. 

An Action Module may be connected to a third party or parties, to the Internet, to other 
. computer systems, or to other networks (even other Personal Server networks). 

d. Messages 


In a preferred embodiment Input/Output ModLle some Messages from the Input/Output 
Module to the Scheduler/Router comprise user information, intended Action Mo'dule or 
modules, message length, time stamp and data specifics. The data specifics contain 
specific commands to the Action Module or Action Modules such asrequests for state 
information as well as any data needed by the Action Module to perform its tasks 

Messages from 1 the Scheduler/Router to the Input/Output Module comprise user 
information^ Action Module identification, message length, time starnp^ and data 
specifics. The data specifics contain responses requested by the user, the results of 
actions performed, state information, response Torrniatting information* and possible 
requests for additional information from the input device. . u . ■■• ■ 

In alternate embodiments Messages may originate or terminate, or be interpreted, parsed, 
decoded, encoded, modified, scheduled, or otherwise processed by the Remote Client; the 
Remote Device,, the Service, the Input/Output Module, the Scheduler/Router, the Action 
Module, or the Controlled Device. Ndw'Input/Output Modules and message protocols 
can be developed by one of ordinary skill in .the art as new technologies, in particular O/S 
device types, are developed. 1 • 

e. Remote Client/Remote Device : ; 
The Remote Client is the user's interface and architecture for the Personal Server. It 
resides on the Remote Device as a data-gathering/presentation medium. The Remote 
Device, in a preferred embodiment, is a handheld PDA such as a PALM 0/S TMb 
WINDOWS CE™ device, or SmartPhone. In alternate embodiments the Remote Device 
may be a desktop personal computer or any form of Internet access device. Since many 
Remote Devices, especially handheld devices, are limited in terms of processing power, 
memory and display capabilities, the Remote Client is generally designed with these 
limitations in mind. Therefore, in a preferred embodiment, the software architecture of 
the present invention relies most heavily on the Personal Server itself, rather than on the 
Remote Client. In some embodiments, a laptop or even desktop computer will act as the 
Remote Device, often connected through a network^ such as the Internet, but even in : f 
these cases, the degree of input available from the computer may be limited. In addition, 
a web page served by a mediating Service on the Internet may serve as the interface for 
communication to the user. This allows limited input through an Internet access device 
such as a SmartPhone or Internet kiosk. < . 

The Remote Client presents an environments that precisely maps to the network of objects 
to be controlled through the Personal Server^ thus allowing seamless control and 
perception over the network. The Remote Client has the appropriate interfaces, which 
communicate with the Input/Output Modules of the Personal Server. The Remote Client 
, is generally designed with the most minimal interface environment that nonetheless 
. remains clear and intuitive to the user. FIGURES 4-6 illustrate sample Remote Client 
environments, including Home Pad, Credit Pad and File Retriever (see "Brief Description 
of Drawings"). While somewhat less complex than an environment on the Personal 
Server itself, such as the X10 control interface of FIGURE 3, Remote Client 
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environments nqnetHeless remain robust and easy, to use. 

The Remote Client also generally uses the minimum amount of encryption and 
authentication necessary to preserve security. Remote Devices, particularly third-party 
Remote Devices, will generally be programmed to operate as the Remote Client. Some 
Remote Devices wil^be, adapted with additional hardware to operate as the Remote . 
Client, and some will be manufactured specifically for use- with the present invention. f 

Remote Devices may use a variety of physical connection.and data transfer protocols to 
communicate with the Personal Server^ some examples of which are illustrated in - • . . 
FIGURE 2. Typically more than one protocol will be available, depending on where the 
user and the. Remote Device happen -to be at the time of linking. The following is another 
way of categorizing the types of connections: 

1. .-ThrQugh the same wireless network that is used to control objects in the home or . ; 
office (used when the user is in or near that home or office). 

2. Through a different wireless network - - . 

3. Through a direct wire-based or wireless connection, such as a serial computer 
interface (used when the Remote Device is "plugged-into" the Personal Server for 
data transfer or programming 

4. Through a dial-in modem connection < 

5. Through a dial-up service, Internet service,' or other mediating Service on the 
- Internet or other Wide- Area networks .»•..■»■ 

Traditional phone lines, leased, lines and satellite connections are among the 
communication' pipes that can be used to suppbrt these physicabconnections. In some 
cases, it will be desirable for the user to authorize third-party access to some or all of the 
control and monitoring systems of the Personal Server. . For instance, a user may allow an 
alarm company to monitor the alarm system.^ The user may also wish to give some access 
to a family member or friend if the user is on vacation or otherwise indisposed. : 

2. Method .., : . , 

a. Direct connection. v ; 

The following flowchart illustrates, as a preferred embodiment, the method of using a 
device constructed in accordance, with the present invention to cany out. a typical task, 
such as programming a VCR. i; -:' ^ i ^ 


3. The user synchronizes the Remote Device by indicating to the Remote Client 
that the information should be transmitted 

4. The Remote Device dials into the Personal Server via cellular modem 



2. 


1. 


:The user enters information concerning the desired action into the Remote 
Device via the Remote Client \ ■- 

The Remote Device stores the information 
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Either of the above Ifowehart embodiments biay be applied, with modific&tioiis, to the ' 
control and monitoring of objects other than the VCR; and to other system embodiments 
described herein. 1 ' > r 

2. Functionality 

The Personal Server is designed to carry out three functions, among othfers: control, 
monitoring and remote information tasks; Other functions are obvious to one of ordinary 
skill in the art. The Personal Server is typically used to control and monitor the following 
types of Controlled Devices: remote-ready objects, non-remote-ready objects and other 
objects. Many Controlled Devices will have both control and monitoring aspects to them, 
(e.g. "is the porch light on?" "turn on the porch light"), though some will have relatively 
more of one type of functionality than the other. - As an example, VCR's have relatively 
more control functions, relating to programming the VCR, than monitoring/stattis 
functions. 

Typically, within the home or office, the Personal Server and its Controlled Devices will 
operate on a wide' area network ("WANT 5 ) or \6tzl area network ("LAN"). In a preferred 
embodiment, Intel's BLUETOOTH^ is the hardware standard and protocol used to put 1 
together the network. Many other hardware and protocol implementation are obvious to 1 
one of ordinary skill in the art. In general, communication nodes will be used to 
broadcast the network signals to Controlled Devices on the network. For example, in one 
embodiment, XI 0 stations are used with the present invention to broadcast the signals. 

a. Remote-ready objects 

Remote ready Controlled Devices are appliances that are already remote-capable. These 
objects typically include VCRs, TVs, CD-players, home or offide security systems, and 
other sophisticated electronic devices that normally come with 1 remote capability 
(generally using infra-red signals, in the current art). In addition, there are many standard 
household controls such as light switches, thermostats, garage doors, and alarm systems 
that are designed specifically for home-automation purposes. The Personal Server takes * 
advantage of such remote capability to communicate with these devices. Many 
Controlled Devices use standardized communication protocols; which makes it a 
straightforward matter to communicate with these devices ("universal" remotes, for 
instance, take advantage of these standards). The Personal Server can b'e programmed 
with additional Input/Output Modules to allow for communication with non-standard 
objects, however. Input/Output Modules may be developed by value-added providers to 
enable the Personal Server to communicate with new arid non-standard devices as they ' f 
are developed. ; < 

As a further illustration, consider the activity of programming a VCR, discussed in the 
above section on overall architecture. The user, could, of course, program the VCR 
directly via the VCR console or remote. The present invention makes it a simple matter 
to. program the VCR from the computer that runs the Personal Server. The user will 
typically enter the time and channel to record, or else a code corresponding to a program 
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5. The PerSSnal Server's Input/Output Module receives the phone call 

6. . TheJfeput/Output Module uploads the;uifonnation from the Remote Device, 

creates a Message, and alerts the Scheduler/Router . : . v 

7. The Scheduler/Router determines that the Message is intended for the VCR 
Action Module 

8. The Scheduler/Router passes the message to the VCR Action Module, which 
parses the Message and in turn sends appropriate instructions to the VCR 

9. The VCR Action Module sends a^new Message to the Scheduler/Router, > 
confirming that the action was or.w^as not taken, among other status details 

10. : The Scheduler/Rquter logs, processes and passes the new Message to the , ; 
: appropriate Input/Output Module,; : . : ! l 

.11. The Input/Output Module responds to the Remote Device, if necessary, 
; reestablishing the connection if need be - , . 

i?. . .The Remote Device displays relevant status information ,to the user via the 
Remote Client , . w - ; -. t , - y -_... , .. < , ...... 

13. The Input/Output Module hangs up the modem connection as necessary 

a. Network-mediated connection. 

The following flowchart illustrates, as an alternate embodiment, the method of using a 
device constructed in accordance with the present invention to carry out a typical task, 
using the Internet as an intermediary cpmmumcatipns mechanism.The user accesses and- 
logs onto the Service using the Remote Client running on the Remote Device. 

2. The Service presents the Remote Client with a .Web page designed as an interface 
for programming a VCR . ./ . .. t ; : : : ; , • , . 

3. The user enters the appropriate information and indicates that the data is 
complete 

4. The Service dials into the Personal Server via dial-up or other connectivity 

5. The Personal Server Input/Output Module receives the call 

6. The Input/Output Module uploads the information from the Service, creates a . * 
Message, and alerts, the Scheduler/Router ^ . 

7. The Scheduler/Router determines that the Message is intended for the VCR . 
Action Module. , t :* fM7i ^ « ■ - 

8. The Scheduler/Router passes the message to the VCR Action Module, which in : 
turn parses the, message. and sends appropriate instruptions to the VCR 

9. The VCR Action Module sends a new Message to the Scheduler/Router, ... . ' 
confirming that the action was or was. not fakenramong other status details ! 

10. The Scheduler/Router logs, processes and:passes the new Message to the 
appropriate Input/Output Module : wor :• :.• ■ \ 

1 1 . The Input/Output Module responds to, the; Service^, if necessary, reestablishing the 
connection if need be. 

12. The Service creates a Web page displaying relevant status information to the user 
. via the Remote Client x , - . 

13. The Input/Qutput Module closes the connection to the Service. . 
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(such as a VCR-PCB5™ code). Inja preferred embodiment, the user is also able to enter 
the name of the program, and the Personal Server, by interacting with a database or data 
source (such. as . a database available on the Internet), determines the program specifics. 
The Personal Server is sophisticate^ enough in its architecture to prompt the user if there 
5 is problem with the information entered, or if it cannot complete the task (for instance, if 
the VQR is already programmed for another program at the same time). It will also 
prompt the user with other status iirfprmation, when it is appropriate. 

Of course, the user generally will wish to program the VCR from a .Remote Device rather 
10 than from the Personal Server itself. The present invention, by connecting the Remote 
Device to the Personal Server in a seamless fashion, makes this effectively the same task. 

b. Non-remote^ready-objects 

Non-remote-ready Controlled Devices, are those objects that typically are not remote 
15 capable. Examples of these objects include microwave ovens, dishwashers, toasters and 
coffee makers. Increasingly, such devices are being manufactured remote-ready. As 
Personal Servers become increasingly common, this trend will likely continue. For 
objects that are. not rempte-ready, a user yyill be able to adapt the objects for remote use 
with additional hardware. At the very least, such objects can be controlled with simple 
20 commands by installing remote switches such as XI 0™ units (see "Other objects," 
below), or, failing that, at least simple on/off switches. 

The programming of a non-remote-ready device is similar in implementation to the 
programming of a VCR outlined above. Oxie difference though is that non-remote-ready 

25 objects tend to be more dependent on status in order to function in an appropriate manner. 
For instance,, there should be coffee in th<? .coffee maker or food in the microwave oven 
before the Personal Server activates these. objects. It is partially for this reason that such 
objects have not been as readily adapted for remote use as.some others have. Leaving a 
tape in a VCR and then wishing to program it later is a common desire. Leaving dirty, 

30 clothes in a washing machine and washing ,them4ater is not so common. Nonetheless, the 
ability to do so must be convenient in some cases, such as turning a coffee machine on in 
the morning. As Personal Servers become more common, users will wish to take 
advantage of these conveniences, and thus, more objects not envisioned as readily 
adaptable to remote use will be made remoterready. , 

35 . : ,' . ; " .^'ri'^l ' ■ . ,, ' ' , ; ; . ; ! _ / ; 

c. Other objects • < 

There are a number of other objects that can be .controlled and monitored with, the 
Personal Server. For example, simple, objepts, such as lighting fixtures can be equipped 
with X-10™ control units, which can be used to turn them on and off and to dim them. 
40 Much more sophisticated objects, such as pools and Jacuzzis, environmental systems, 
weather stations and television cameras, among others, can be controlled and. monitored 
with the present invention. Again, the user may well need to adapt these objects for use 
with the Personal Server by installing hardware attachments. . ^ 
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One form of Controlled Device that merits special attention is a home or office computer. 
Either the Personal Server itself, or a separate computer, may function as a Controlled 
Device when operated in connection with the present invention, operated remotely via the ' 
Remote Client to perform a variety of tasks such as sending or retrieving electronic mail, 
5 voice mail, or faxes, uploading and downloading files, and connecting to the Internet. 

The types of Controlled Devices that can be incorp orated into the Personal Server system 
are almost limitless. As one example, the system can be used to detect how many cars are 1 
sitting in the garage or driveway through the use of cameras, external sensors or chips 

0 embedded in cars. The latter is a particular dheap ^ 

automobiles into the domain of the Personal Server. Mbre sophisticated control features, 
such as remote car warmers, security systems or ignition devices, will become amenable' 
to the present invention as available technology improves, and as users, vendors and 
inventors become more accustomed to and imaginative about such uses/ One of ordinary 

5 skill in the art can imagine boundless examples. Iri this Way, the present invention 
provides a broad basis for fixture technical development. 

d. Remote Information Tasks 

One of ordinary skill in the art will appreciate that rerripte information uses will also 
.0 proliferate as technology, commercial innovation and commercial imagination develop. 
One current use is the transfer of computer fifes, such as video, spreadsheets, word 
processing documents and figures between the Remote Client and the Persona! Server. 
These files may be used as part of the various control and monitoring features of the 
Personal Server, for example; remote viewing of images or streaming video from 
\5 household cameras, or they may be entirely unrelkted. 

Communication can be done continuously; or in bursts, depending on need. Either the 
Remote Client of the Personal Server, and in s'oiiie embodiments; objects in the network, 
can initiate and terminate communications. If there is a calculation or process that takes a 
10 great deaiof time, the user may initiate the process remotely, terminate communication,- 
and then check in from time to time to see if the process or calculation has been 
completed. : 

Li one embodiment, the Personal Server can act as a'piass^througK communications link- ' 
15 for the Remote Client. For instance, the user can surf tHe'hiterhet remotely from the ' 
Remote Device via the Personal Server. Computational tasks and file retrieval can be 
done in a similar manner. The user can accomplish these tasks in real-time or else send • 
the task to the Personal Server 'and then' end- the transmission. At sortie later time, when 
the Personal Server has completed the task orfecjuires additional information, the 
10 Personal Server* may request that communicaLtion be reestablished. 

One particularly convenient use for the present invention applies to credit-card 
transactions. Merchants using the current invention can verify credit-card numbers by 
uploading them from the Remote Device (which-will generally have a card reader) to the 
\5 Personal Server for verification. A credit-card charge can be carried out in a similar 
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maimer. Other, transactions, financial and otherwise, are obvious to one of ordinary skill 
in the art. 

Though the foregoing invention has been described in detail for purposes of clarity of 
understanding, it will be apparent that various changes and modifications may be 
practiced within the scope of the appended claims. It is therefore intended that the 
following appended claims be interpreted as including all such alterations, permutations, 
and equivalents as, fall within the spirit and scope of the present invention. AIL 
publications and patents herein are incorporated by reference in their entirety. . ■ ? 

- . <• > References - - . . 

U.S. Patent 5,809,415, "Method and Architecture for an Interactive Two- Way Data 
Communication Network/ ' issued to Rossmann. ; 
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Claims 

What is claimed is: .< 1 

1 A system for remote control and monitoring of objects,- the system comprising: 

(a) A personal server, which comprises a sterver-like apparatus that performs actions 1 
chosen &om a list that includes: - : • < • ■ ii ' 

i. receiving user commands, processing those commands, and outputting 
those commands to objects that are networked to the personal server; and 

ii. receiving status information from objects that are networked to the 
•personal server; and * ■ ■. . r \~ > 

(b) An integrated network for communicaticm between the personal server and the • 
objects, wherein said personal server performs one or more actions chosen from 
the list comprising control and monitoring. 

2 The system described in claim 1 further comprising a means of remote connectivity 
from the user to the personal server. 

3 The system described in claim 1 wherein said personal server logs said commands. 

4 The system described in claim 1 wherein said personal server comprises software run 
on a general-purpose computer. 

5 The system described in claim 4 wherein said software comprises action modules, and 
a scheduler/router. 

6 The system described in claim 5 wherein said action modules communicate with said 
objects. 

7 The system described in claim 6 wherein at least some of said action modules are 
specially-designed to interface with devices having non-standard remote protocols. 

8 The system described in claim 6 wherein at least some of said action modules are 
general-purpose interfaces which communicate with devices with standard remote 
control protocols. 

9 The system described in claim 5 wherein said software further comprises I/O modules 
chosen from a list that includes input modules, output modules, and combined 
input/output modules. 
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10 The system described in claim 1 wherein said I/O modules cpimnunicate with a 
remote client. 

1 1 The system described in claim 1 wherein at least some of said objects on said network 
are controlled and monitored via means chosen from a list that includes infrared 
communication, XI 0 protocol, TCP/IP protocol, or Bluetooth protpcpl. 

12 The system described in claim 1 wherein at least some of said objects on said 
networke are controlled and monitored vi^ a wireless protocol, 

13 The system described in claim 1 wherein broadcasting stations are used to broadcast 
network signals to said objects. 

14 The system described claim 13 wherein said broadcasting stations are HOUSELINC ; 
stations. 

15 The system described in claim 1 wherein at least some of said objects are remote 
ready. • . t . . , . f 

16 The system described in claim 1 wherein at least some of said objects are specially 
adapted for use with said system. , , ; 

17 The system described in claim 1 wherein at least some of said objects are not remote- 
ready objects and have been enabled to communicate with said personal server using 
special control attachments. 

1 8 The system described in claim 17 jwherein said attachments use X10 technology. 

19 The system described in claim 17 wherein said attachments use LonTalk technology. 

20 The system described in claim l^vherein at, least some of said objects are chosen from* 
the list that comprising VCRs, TVs, home entertainment systems, kitchen appliances, 
light fixtures, pools, Jacuzzis, alarms systems, environmental controls, cameras, 
microphones,, personal computers, security systems, and weather stations. . 

21 The system described in claim 1 wherein said system is used in a home or office. 

22 The system described in claim 1 wherein said personal server is written , using C^C+t 
or Java. 

23 The system described in claim 1 wherein said personal server is an off-the.shelf 
component or a component of a hardware system. 

24 The system described in claim 1 wherein said personal server is part of a third-party 
proprietary system or a custom-developed system. 
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25 The system described in claim 1 wherein said network is a wireless network. 

26 The system described in claim 25 wherein said wireless network is a LAN, WAN or 

VPN. 

27 The system described in claim 25 wherein said network hardware is on a ' 
BLUETOOTH standard. 

28 The system described in claim 25- wherein the network protocol is JESTL 

29 The system described in claim 1 further comprising a demote device from which a 
user enters said commands. .* t •.■■■< . 

30 The system described in claim 29 wherein said remote device is a PDA. 

31 The system described in claim 29 wherein said remote device is a SmartPhone. 

32 The system described in claim 29 wherein said PDA is a PALM OS or WINDOWS 
CE device. 

33 The system described in claim 29 wherein the remote device runs remote client 
software. 

34 The system described in cliim 33 wherein' the; remote client software is specially 
programmed for use with said system. 

35 The system described in claim 33 wherein the remote client software is an application 
running on a computer including the computer on which the personal server is 
running^ : ' ' ■ 

36 The system described in claim 29 wherein said remote device is a general -purpose ' 
computer.' ** 1 5 "" - * " " ,l - : 

37 The system described iti cliim 29 wherein ^aid* remote device is ah Internet access 
device 

38 The system described in claim 29 wherein said remote device is used to scan credit 
cards for processing by said personal server. : i :f ' 

39 The system described in claim 29 wherein said remote device is hardware-adapted for 
use with said system. ~ ! • 

40 The system described in claim 29 wherein said remote device is specifically 
manufactured for use with said system. ! ' 
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41 The system described in claim 29 wherein said remote client communicates with said 
personal server via a cellular modem connection^ * f ' 

42 The system described in claim 29 wherein said remote client communicates with said 
personal server via a serial connection. 

43 The system described in claim 29 wherein said remote client communicates with said 
personal server via a leased-line or satellite connection. 

44 The system described in claim 29' wherein said remote client communicates with said 
personal server via a LAN, WAN or VPN. ; 

45 The system described in claim 29 wherein said remote client communicates with said 
personal server via the Internet. J 

46 The system described in claim 29 wherein said remote client communicates with said 
. personal server via a service on the Internet. 


WO 01/63389 


18 


PCT/US01/05073 


AMENDED CLAIMS 

1 [received by the International Bureau on 09 July 2001 (09.07.01); 
original claims 1,12 and 29 amended ; remaining claims unchanged (3 pages)] 

A system for remote control and monitoring of objects, the system comprising: 

(a) a personal server, which comprises a server-like apparatus that 
performs actions chosen from a list that includes: .•.»*.,.- 

i . receiving user commands ■ processing those commands, and - • ' >' : ^ 
outputting those command to objects that are networked to tijie 
personal server; and / , t 

ii. receiving status information from objects that are networkedjto 
the personal server; and 

(b) an integrated network for communication between the personal serv|ei 
and the objects, wherein said personal server performs one or more 
actions chosen from the list comprising control and monitoring. 

(c) a remote device which communicates with the personal server and 

includes: a microprocessor, a memory, and an integrated visual display 
for displaying graphical user interfaces. 


2. The system described in claim 1 further comprising a means of remote 
connectivity from the user to the personal server. 

3. The system described in claim 1 wherein said personal server logs said 
commands. 

4. The system described in claim 1 wherein said personal server comprises 
software run on a general-purpose computer. 

5. The system described in claim 4 wherein said software comprises action 
modules, and a scheduler/router. 
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6. The system described in claim 5 wherein said action modules con^nunicate , 
with said objects. ' 

. ■ . . ■ ■ ! 

7. The system described in claim 6 wherein at least some of said action modules 
5 are special ly-designed to interface with devices haying non-standard remote ;* 

protocols. . 

8. The system described in claim 6 wherein at least some of said ; action modules 
are general purpose interfaces which communicate with devices with standard remote 

10 control protocols. 

9. The system described in claim 5 wherein said software further comprises I/O 
modules chosen from a list that includes input modules, output modules, and 
combined input/output modules. 

10. The system described in claim 1 wherein said T/O modules communicate with 
a remote client. t , . . r . ; . 

1 1 . The system described ui plaim 1 wherein at least some of said objects on sa|d 
20 network are controlled and monitored via means chosen from a list that includes 1 

infrared communication, XI 0 protocol, TCP/IP protocol, or Bluetooth protocol. 

1 2. The system described in claim 1 wherein at least some of said objects on said 
network are controlled and monitored via a wireless protocol. 

25 r f . 

13. The system described in claim I wherein broadcasting stations are used to 
broadcast network signals to said objects. 

14. The system described claim 13 wherein said broadcasting stations are, 
30 HOUSELINC stations. 
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24. The system described in claim 1 wherein said personal server is part of a ttijui 
party proprietary system or a custom-developed system. 

25. The system described in claim 1 wherein said network is a wireless networf:, 

26. The system described in claim 25 wherein said wireless network is a LAN,' 
WAN or VPN. f " 

27. The system described in claim 25 whereih said network hardware ik 6n a 
10 BLUITTOOTH standard. ' " : i . : : > v ,• 

28. the system described in claim 25 wherein the network protocol is JTNL 

29. The system described in claim 1 wherein ftiereittote device communicates 
15 with the personal server via a direct electrical connection, a modem; a network, ligljt 

wave data transmission, or radio frequency data transmission. 

30. The system described in claim 29 wherein said remote device is a PDA. 

20 31 . The system described in claim 29 wheireiri said remote device is a 

SmartPhone. ■ • 

32. The system described in claim 29 wherein said PDA is a PALM OS or 
WINDOWS CE device. ' . " " " ' " "" \ 

25 ' " " ' ' ' : 

33. The system described in claim 29 wherein the remote device runs remote 
client software. 

34. The system described in claim 33 wherein the remote client software is 
10 specially programmed for use with the system. ' 
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Claim 1 was to amended to correct format errors and add the limitation of "a 
remote device which communicates with the personal server and includes: a 
microprocessor, a memory, and an integrated visual display which can display a pluraljty 
of graphical user interfaces " The term "A personal server" was amended to "a personal 
server" and the term "An integrated network" was amended to "an integrated network^ 

Claim 12 was amended to correct a typographical error. The term "networke" ip 

- . ' ■ . * ^ 

now "network." 

Claim 20 was amended to correct a typographical error. The term "alarms 
systems" is now "alarm systems/* 

.... ' ( . / , : • . . „ 

Claim 29 depends from claim I and was amended to remove the limitation that|the 
system further comprises a remote device from which a user enters said commands. Tfc 
remote device limitation is part of the amended claim 1. Claim 29 was also amended t|) 
add the limitation that the remote device communicates with the personal server via a 
direct electrical connection, a modem, a network, light wave data transmission, or radif 
frequency data transmission. 

The amendment adding the remote device having a microprocessor, memory aqa 
integrated display is supported by the application specification. "The Remote Device, >n 
a preferred embodiment, is a handheld PDA such as a PALM O/S 7 " Windows Cis 7 \ or 
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StnartPhone. In alternative embodiments the Remote Device may be a desktop personal 
computer or any form of Internet access device. Since many Remote Devices, especially 
handheld devices, are limited in terms of processing power, memory and display 
capabilities, the Remote Client is generally designed with these limitations in mind," 
( Application, page 8, lines 21-28.) Although the remote device has processing, memory 
and display limitations, it is still capable of running software, storing data and processing 
information. 

The references cited in the PCT International Search Report do not include a 
remote device having a microprocessor, memory and an integrated visual display for 
displaying graphical user interfaces. 

1. Humpleman et ah. U.S. Patent No. 6 A 98.479 

U.S. Patent No. 6,198,479 (Humpleman et al) was cited in the International 
Search Report as being of particular relevance. The Humpleman reference discloses a 
control system which uses a personal computer to operate devices connected to a network. 
The applicant respectfully submits that Humpleman does not disclose the remote device 
having a microprocessor, programmable memory and a visual display which 
communicates with the personal server. Humpleman discloses a "control device" whiqh 
is a computer haying a monitor and a mouse and controls "home devices." u By way of 
definition, it is contemplated that a 'client 11 is a device providing control interface service 
to a human operator, including a graphical display hardware for down communication »nd 
a mouse or other point-and-click device for up (or return) communication/* (Humplcn^an, 
Col. 5, lines 30-34,) "Thus, in certain embodiments of the inventions, a device such an a 
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personal computer (TC') is used to provide the human interface for a respective home 
network, as a PC typically embodies a screen display unit" (Humpletnan, Colf : 6; lines *5- 
9.) The applicant did not find a description of a control device other than a personal 
computer in the Humpleman reference. 

2. Ogino et al„ U.s! Patent No. 6.038.(525 

U.S. Patent No, 6,038,625, (Ogino et al.) was also cited in the International Seaich 
Report as being a reference of particular relevance. The Ogino reference discloses a set| top 
box which is used to control networked components. ** Although a variety of different 1 
computer systems can be used with the present invention, an exemplary general putposfe 
computer system is shown in the set-top-box FAV of FIG. 2." (Ogino, Col. 8, lines 1 lil4,) 
The Ogino reference does not disclose the user interface with the set top box and does not 
disclose a remote device having a microprocessor and visual display. 

3. U.S. Patent No. 5.982.445 Evcretal. 

US. Patent No. 5,982,445 Eycr et al. discloses a control system which displays 
HTML information on a television, "In accordance with the present invention, an apparatus 
and method are presented for providing textual and graphical displays using hypertext 
markup language (HTML) for use with a television decoder." (Eyer, Col, 4, Lines 21 h- 24.) 
The control system disclosed in Eyer is controlled by a user with an input device which can 
be a remote control* however the disclosed remote control does not include a microprocessor 
or an integrated visual display. "The user command may be input, for example, by a njouse 
or other pointing device, a keyboard, or an infrared remote control or the like." (Eyer, iCoh 9. 
lines 3-5.) No additional details of the infrared remote control unit are disclosed, 
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It is respectfully submitted that the amended claims included on the attached 
substitute pages involve an inventive step that is not obvious to one skilled in the art in |ight 
of the cited references, either alone or in combination. 

It is further respectfully submitted that the amendments made to the claims do npt 
amend or otherwise impact the description and ^awings aboriginally filed. 
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